Exploring the Landscape of Brain States 
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Introduction 


The goal is to understand neurodynamics, 
identify attractor States, their properties, 
understand how neural processes give rise 
to attention and conscious mental States 
during spontaneous thinking or mind wandering. 

Using trained, biologically plausible model of neural network that 
has leamed associations between phonology, orthography and 
semantic of many words, implemented in the Emergent Simulator, 
we are investigating the landscape of attractor States using fuzzy 
symbolic dynamics visualization and recurrence plots. 

Hypothesis: transient States are not perceived in a conscious way, 
perception requires formation of a quasi-stable State where 
trajectory of the system falls into basin of some attractor, 
transitions between attractors generate “stream of consciousness”. 



Recurrence Plots 

Eckmann et al. (1987) introduced recurrence plots, a generał 
method for analysis of dynamical systems 


A trajectory x i =x(t i ) returns to almost 

the same area (within s distance) at some 
other point in time, creating non-zero 
elements (or black dots in the plot) of the 
recurrence matrix: 
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With some experience such plots allow for Identification of many 
interesting behaviors of the system. However, these plots depend 

strongly on the choice of s and the choice of the time step A t=t i+l -t i . 


Model of Reading 


Emergent neural Simulator: 

Aisa, B., Mingus, B., and 0'Reilly, R. The emergent neural 
modeling system. Neural Networks 21, 1045-1212, 2008. 

3-layer model of reading: 
orthography, phonology, 
semantics, or distribution 
of activity over 140 
microfeatures of concepts. 

Hidden layers in between. 


Learning: mapping one of 
the 3 layers to the other two. 

Fluctuations around finał 
configuration show basins 
of attractors representing 
concepts. How to see their 
properties and relations? 

Trajectories of the activity of 140 neurons in the semantic layer, 
subject to synaptic noise and neural fatigue, oscillate in attractor 
basins that correspond to word semantics. Trajectories of 4 pairs of 
correlated words are shown, with concrete words in the first two 
pairs (flag, coat, hind, deer) marked in blue, and abstract words 
(wagę, coat, loss, gain) as the last two pairs, marked in red-yellow. 



Aclnratmn ir Semantics layer [dyslex proj) 



Trajectories are good for ... 


New area in psycholinguistics: investigation of dynamical cognition, 
influence of masking on semantic and phonological errors, temporal 
dynamics in perception, effects of priming, associations, continuous 
mental trajectories, formation of mems and their influence on 
thinking and relating mental States to neural/brain properties. 

M. Spivey, Continuity of mind. Oxford University Press 2007. 

P. McLeod, T. Shallice, D.C. Plaut, Attractor dynamics in word 
recognition: converging evidence from errors by normal subjects, 
dyslexic patients and a connectionist model. Cognition 74, 91-113, 
2000 . 




In the analysis of high-dimensional 
dynamical systems it is better 
to plot all distances between 
trajectory points using color scalę 
for distance determination. 

The recurrence matrix is given by: 

R tj = x i ~ x j 


Such recurrence plots may be 
smoothed using non-linear distance 
function ||j|, capturing essential info 
about systerrTs behavior, especially 
its attractor dynamics. 


Recurrence plots have wide applications for analysis of time series, 
including high-dimensional neurodynamical systems, but their 
interpretation is not always easy; FSD complements them. 


Fuzzy Symbolic Dynamics 

Fuzzy Symbolic Dynamics (FSD) is used to: 

• Reduce dimensionality of trajectory x(f), visualize it in 2 or 3D. 

• Estimate properties of attractors: number, position, strength. 

• Can be combined with time-frequency or component analysis. 

Algorithm: 

1. Standardize data. 

2. Find cluster centers (e.g. by k-means algorithm): ju 1 , p 2 , ■■■ 

3. Use non-linear mapping to reduce dimensionality: 

y k Mk exp(- (*(0 - ) T (x(0 - Mk )) 

Reference points may be optimized to resolve minimal distances. 
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Conclusions 

1. Spivey (2007) recommended symbolic dynamics for 
investigation of mental States, but recurrent plots and fuzzy 
symbolic dynamics may show in a much better way the 
continuity of mental States. 

2. FSD/RP type of visualization shows the microstructure of 
cognition, at the conscious as well as subconscious levels, with 
fast transition States and 

3. With morę detailed models of neurons many phenomena 
related to mental States, associative thinking, attention deficits, 
temporo-spatial Processing disorders and other mental 
problems may be investigated, and connected to experimental 
observations. 

4. FSD/RP analysis may be applied to any multi-channel signals, 
applications to real EEG data are in progress. 


Recurrence Analysis 

The model of reading (used also for dyslexia) was modified adding 
accommodation (neural fatigue) mechanism into neuronal units 
based on K + (Ca ++ ) ion channels, plus synaptic Gaussian noise with 
zero mean and 0.02 variance that provides an extra energy to 
facilitate free evolution. 

Interesting properties can be obtained from recurrence plots: 

1. Blue squares along the diagonal linę show attractor basins. 

2. The size of each square represents time that the system is 
spending in each attractor. 

3. The color intensity allows for estimation of the strength of the 
attractor, e.g. dark blue square indicates a very strong attractor 
with smali variance; color distribution gives some idea about the 
shape of attractor basin. 

4. Recurrence analysis shows States to which the system is 
returning during evolution, displaying distance between 
attractors. Blue squares outside the diagonal linę indicate that 
the distance between these two attractor basins is smali, and if 
the square is uniformly dark blue, that the system has returned to 
the same basin of attraction. 

5. Błock structure depends mostly on accommodation parameters 
of neurons, attractor basins vanish when neurons are fatigues, 
and this facilitates jumps to distant attractors. 



Results 

Neurodynamics of this model shows many interesting properties: 

1. The landscape of attractor basins available for neurodynamics is 
not fixed, but changes depending on the history and context of 
the current event - the same stream is never entered twice. 

2. Structure of spontaneous transitions between States of semantic 
network is regulated by the synaptic noise and neural 
accommodation, giving rise to different speed of mental time 
flow. 

3. Depending on the network parameters (inhibition vs. excitation, 
neural accommodation due to leak ion channels etc.), availability 
of neurotransmitters, attractor basins may be deep and entrap 
neurodynamics, making the attention shifts difficult (leading to 
autism-like behavior), or it may be too shallow and the system 
will not be able to focus attention (ADHD-like behavior). This 
may be investigated by plotting the trajectory variance in 
attractor basin against noise 
variance: steep rise signifies 
weak attractors, while slow 
rise means strong (deep and 
narrow attractors). 

4. Strong recurrent connections 
lead to fewer but larger 
basins of attraction. 


Size of attractor basins in semantics layer [dyslex.proj] 
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